Multimodal Media Center Interface Based on Speech, Gestures and Haptic Feedback
نویسندگان
چکیده
We present a multimodal media center interface based on speech input, gestures, and haptic feedback (hapticons). In addition, the application includes a zoomable context + focus GUI in tight combination with speech output. The resulting interface is designed for and evaluated with different user groups, including visually and physically impaired users. Finally, we present the key results from its user evaluation and public pilot studies.
منابع مشابه
Speech-based and multimodal media center for different user groups
We present a multimodal media center interface based on speech input, gestures, and haptic feedback. For special user groups, including visually and physically impaired users, the application features a zoomable context + focus GUI in tight combination with speech output and full speech-based control. These features have been developed in cooperation with representatives of the user groups. Eva...
متن کاملMultimodal Interaction with Speech, Gestures and Haptic Feedback in a Media Center Application
We demonstrate interaction with a multimodal media center application. Mobile phone-based interface includes speech and gesture input and haptic feedback. The setup resembles our long-term public pilot study, where a living room environment containing the application was constructed inside a local media museum allowing visitors to freely test the system.
متن کاملMultimodal Human-Machine Interaction for Service Robots in Home-Care Environments
This contribution focuses on multimodal interaction techniques for a mobile communication and assistance system on a robot platform. The system comprises of acoustic, visual and haptic input modalities. Feedback is given to the user by a graphical user interface and a speech synthesis system. By this, multimodal and natural communication with the robot system is possible.
متن کاملAUDIO FOR A MULTIMODAL ASSISTIVE INTERFACE Demo paper for the ICAD05 workshop "Combining Speech and Sound in the User Interface"
This paper details the design of an audio interface for a multi-modal content-aware web plug-in. The system aims to provide spatial and navigational information to visually impaired Internet users through speech and non-speech audio with haptic feedback. The web plug-in and audio interface are presented and discussed, along with recommendations for future system development.
متن کاملCombining Multiple Input Modalities for Virtual Reality Navigation – a User Study
This usability study aims at evaluating in which way different groups of users deal with a multimodal interface for navigating in arbitrary virtual worlds. Besides classical input devices like keyboard, mouse and touchscreen the test subjects can control the system by natural speech utterances as well as dynamic hand and head gestures. Experts tend to use haptic devices, whereas normal computer...
متن کامل